Papers by Joo Bon Maeng
Goal-Conditioned DPO: Prioritizing Safety in Misaligned Instructions (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing defense methods focus on aligning the model’s output towards less harmful responses through post-processing or input perturbation. |
| Approach: | They propose a goal-conditioned direct preference optimization technique which is trained to prioritize the system prompt over the user prompt through goal-conditioning and reduces the average Attack Success Rate (ASR) on a wide variety of jailbreak attacks. |
| Outcome: | The proposed approach reduces the average Attack Success Rate (ASR) on a wide variety of jailbreak attacks while maintaining general performance. |